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Abstract — In this paper, we propose an extended version of 
the memristive STDP model, which is one of the most important 
and exciting recent discoveries in neuromorphic engineering. The 
proposed model aims to claim compatibility with another impor- 
tent STDP rule beyond the pair-based rule, known as the triplet 
STDP rule. This is an extension of the asynchronous memristive 
model of Linares-Barranco, et al., capable of explaining the pair- 
based rule based on the analogy of the synapse to the memristor. 
The proposed new model is compatible with both the pair-baed 
and triplet-based rule, by assuming a mechanism of variable 
thresholds adapting to synaptic potentiation and depression. The 
dynamical process is governed by ordinary differential equations. 
The model is an expression of Froemke's principle of suppression 
for triplet rules and reveals a similar time dependence with that 
in the suppression STDP model. 

Index Terms — memristor, neuromorphic system, STDP, non- 
linear system. 

I. Introduction 

Since decades, the study on nervous systems has aroused 
great interest in researchers that span across muHtple fields, 
growing out far beyond a single research branch to a complex 
scientific territory of mutually inspiring disciplines involv- 
ing biology, mathematics, physics, electrical engineering and 
computer science. Biological discoveries have been inspiring 
engineers in the sense of realizing intellectual systems and 
networks, while concepts in arificial systems are also providing 
new insights in understanding biological nervous systems. Re- 
cently, an important discovery was made on the explanation of 
the spike-timing-dependent-plasticity (STDP) in the neuronal 
communications based on a memristor model L1J-U|. The 
STDP rule is one of the fundamental properties in the neurons, 
which permits adaptation of developing nervous systems to the 
surrounding environment ISl- lfTTl , whereas the memristor, on 
the other side, is considered as a fourth fundamental electrical 
element, which was originally proposed by L. Chua |12||13| 
and recently implemented in material at a nano-scale 1 14 |. The 
researchers point out in | 5 1 that the synapse between a pair of 
communicating neurons has similar function of a memristor, 
attributed to the long-term memory of weight changes in 
the device. This connection makes it possible to realize an 
intellectual system by the means of highly integrated nano- 
devices, in the direction of which several research groups have 
proposed realizable schemes, leading to either synchronous 
or asynchronous systems. Most notably, in understanding the 
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long-term plasticity of neurons biologically, this mechanistic 
model also provides a completely new way by uniquely taking 
into account two important properties of the neurons: the 
specific waveforms of the action potentials and a synaptic 
threshold. These properties makes the model different from 
the original behavioral model of Gerstner and Pfister, esp., in 
explaining the STDP update function, which is imposed in an 
ad hoc manner in the original model |10|. 

The pair protocol, consisting of a pair of pre- and post- 
synaptic spikes, is the basic rule in STDP. However, the 
memristive STDP model, like many other mechanistic models, 
has direct conflicts in explaining more complicated signal 
patterns such as the triplet rule. In |15|, Froemke and Dan 
conducted a series of experiments on the triplet protocol in 
pyramidal neurons, which evaluates the synaptic modification 
involving three action potentials (single pre-synaptic and dual 
post-synaptic spikes comprising the 1/2 case, and dual pre- 
synaptic and single post-synaptic comprising the 2/1 case), and 
concluded their observations as: "The first spike pair played a 
dominant role in synaptic modification^' This is unexplainable 
either by the original pair-based model of Gerstner or by 
the memristive model, because these models assume that 
the two spike pairs contribute independently to the synaptic 
modification. In fact, the triplet protocol is considered as 
another important criteria for a STDP model, in parallel with 
the pair protocol ifTSll - lfTSl . In order to be compatible with 
both the pair and triplet rules, modifications have been made 
based on the existing pair-based models. Froemke and Dan 
proposed a suppression model by assuming a spike efficacy 
as an extra indicator based on the original STDP model, 
which is suppressed by preceding spike in each neuron ifTSl . 
Pfister and Gerstner rather abandoned the basic assumption of 
paired spikes as the fundamental unit, and proposed a model 
considering that both pair and triplet are fundamental units to 
contribute to the synaptic modification |16|. The memristive 
STDP model, though explained successfully the pair-based 
STDP rule, is also confronting the triplet problem, which 
needs a modified version to be compatible with both pair and 
triplet protocols. In this paper, we exploit such possibility by 
proposing a memristive STDP model based on the mechanism 
of variable thresholds adapting to preceding synaptic modifi- 
cation. The modified memristive model, reserving the ansatz 
of paired spikes being the fundamental contributing unit, can 
explain the triplet rule in STDP by introducing suppression 
on a temporal base, which is a memristive realization of 
Froemke's principle. In the following sections, we will first 
briefly review the pair-based memristive STDP model and 
the confronting triplet problem. The memristive STDP model 
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with adaptive thresholds will be proposed in Sec. Ill as a 
scheme of compatiblity with the triplet rule problem under 
the principle of suppression. In Sec. IV, we will point out 
potential biological relation to the process, and generalize the 
model to an extended form. A conclusion will be made in Sec. 
V. 

II. Pair-Based Memristive STDP Model and 
Triplet Rule 

The STDP is a causality-based Hebbian rule with extension 
to both potentiation and depression, which features a critical 
role of relative timing of pre- and post- synaptic action po- 
tentials in the change of the synaptic efficacy |8||19|. The 
causality is revealed in its principle that, within a certain time 
window involving a pair of spikes, pre-synaptic spike pro- 
ceeding post- synaptic spike produces long term potentiation 
(LTP, positive change) in the synaptic efficacy, while post- 
synaptic spike proceeding pre-synaptic spike produces long 
term depression (LTD, negative change). This is often referred 
as the pair-based STDP rule. The memristive STDP models 
are established based on the analogy of long-term memory of 
the conductance (or indirectly, the weight) of the memristor to 
the efficacy of synapses. We here consider the asynchronous 
memristive STDP model proposed by Linares, et al. |5|. As 
demonstrated in Fig.[T} the model assumes that the funtionality 
of a synapse can be modelled as a memristor with two 
thresholds. The modification of the conductance (the reciprocal 
of the memristance), corresponding to the synaptic efficacy, 
is governed by a function of the weight of the memristance 
(supposing that the memristance is linearly controlled by the 
weight R{w) = kR{w-\-wo)) and the voltage difference of the 
pre- and post-synaptic action potentials over the thresholds: 

^ = -f{w,Av{t)) (1) 

where Av{t) is the difference between the membrane poten- 
tials 

Av{t) = Vposit) - Vpre{t) (2) 

The minus sign in Eq. ([T]) is for excitatory synapses. In O, 
the function / is chosen to be an exponential function solely 
on the voltage difference 
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In this manner, the STDP update function can be predicted 
to be in accordance with experimental records ll5llll2Ql . This 
mechanism is based on paired spikes. 

It is notable that the memristance is additive with such 
choice of function / (whereas the synaptic efficacy is mul- 
tiplicative). This implies that the total change of memristance 
is simply the sum of independent changes in all time intervals, 
with each consisting change depending only on Av{t), but not 
on the actual weight w (or the memristance R) 



f{Av{t))dt = ^AR{tk-i 
k=i 



> tk) 
(4) 



Fig. 1. The memristive pair-based STDP model. Plots are modified from 
|5J. (a) The analogy between a synapse and a memristor. (b) Demonstration 
of the pair-based model for the pre-post case (LTP). (c) The piecewise rate 
function / of the synaptic modification and its first order approximation for 
small Av ± Vfho- 



Its geometric implication can be seen intuitively. To the first 
order of Eq. ([s]), the function f{Av) is a piecewise linear 
function of Av (the dashed line in Fig. [ijc)) 

f{Av{t)) = ^ {[Av{t) - vthU + [A^W + Vth]-) (5) 

^0 

Hence, for small extra voltage over the thresholds [Av{t) — 
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Fig. 2. The synaptic modification predicted by the pair-based memristive 
STDP model (the pre-post-pre case), (a) pre-synaptic spikes Vpre(t)'. it is 
assumed that the first spike turns to the second spike abruptly at the presence 
of the second spike; (b) post-synaptic spike Vpost(t); (c) the voltage difference 
function Av(t) = Vpost(t) — Vpre(t). For the pair-based model, the areas 
j^LTP A^^^ are referred to the fixed thresholds ^vtho^ respectively. 
The parameters for the spike function spk{t) are chosen as follows: = 
1, A^,n = 0.5, t^-j = 2.5 ms, t~^i = 37.5 ms, Tp = 3 ms, Tm = 40 ms, 
10 ms, t2 



the time intervals: ti 



10 ms, and the threshold: vthQ = 1- 



Vth]-\- and [Av{t) + Vth]- compared to the thresholds, the 
total change of memristance can be viewed as the net area 
enveloped by the curve Av{t) and the thresholds, multiplied 
by a factor kRio/vo (see Fig. [2jc)) 
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With the property of additivity, let us consider the synaptic 
modification corresponding to a triplet of spikes, involving 
two pre-synaptic and one post-synpatic spikes (the 2/1 case). 
According to the pair-based STDP rule and the additivity, 
the total change of the memristance is the sum of an LTP 
produced by the pre-post pair and an LTD produced by 
the post-pre pair (see Fig. |2]). Especially, when the interval 
between the first pair is equal to that of the second pair, 
the netto change of memristance sums to zero. However, this 
prediction is not in accordance with the triplet rule observed 
from experiments. In ifTSl , Froemke and Dan concluded their 
experimental results that for triplet spikes, the first spike 
pair plays a dominant role in synaptic modification, or more 
specifically, the prediction based on the interval of the first 
pair (ti) is better than that based on both intervals of the two 
pairs iti and ^2) combined. It indicated that the two spike pairs 
do not contribute independently to synaptic modification, and 



the contribution of the second pair is strongly suppressed by 
the presence of the preceding pre-synaptic spike. The synaptic 
modification induced by the triplet, however, can be largely 
predicted by the second pair only when the first time interval 
is sufficiently large. This is the principle of suppression for 
the triplet STDP rule. For the pre-post-pre case, the synaptic 
modification should mainly express as LTP, and especially, 
should be nonzero for the case of equal intervals (ti = ^2)- 
This discordance implies that the pair-based memristive model 
needs a modification to be compatible with the triplet STDP 
rule. 

III. Memristive STDP Model with Adaptive 
Thresholds 

The principle of suppression for the triplet rule can be 
realized in the memristive STDP model by introducing a mech- 
anism of adaptive thresholds. In this model, the thresholds 
are no longer rigid, but can vary according to the synaptic 
modification. We denote the positive threshold as the LTP 
threshold v^^^{t), and the negative threshold as the LTD 
threshold v^^^{t). It is supposed that the LTD threshold can 
rise by the presence of an LTP, while the LTP threshold can 
rise by the presence of an LTD. Both thresholds decrease 
exponentially to the resting values in the absence of LTP or 
LTD. The synaptic modification is then controlled not only by 
Av{t) but also by the actual value of the threshold v^^^{t) or 

LTD 
^th 



{t). In this way, an LTP suppresses the following LTD 
to a certain extent by raising the LTD threshold, while an 
LTD also suppresses the following LTP in the same manner, 
as demonstrated in Fig. |3] This process can be described by 
the following ordinary differential equation pair: 
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with the update of the synaptic weight 

dw 

where ±Vtho denotes the resting LTP and LTD thresholds, 



[Av{t) - v^,'^{t)U - [^v{t) - ^(t)]- (9) 



respectively; 
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and 



^LTD 
'th 



are the decreasing rates for 



the two thresholds. The changing rates of the thresholds 
are supposed to be linearly dependent on dw/dt with the 
factors kpD and k^p, so that, by integration, the change 



in vj^if ^ or vj^^ ^ is proportional to the change of w, i. e., 

LTPiD^ 

Av^^ ^ ^ oc Aw, though generally it is not limited to linear 
dependence. For simplicity and geometric intuition, a linear 
synaptic update equation is also used in Eq. ([9]). 

For a triplet of spikes, e.g., the pre-post-pre case, the first 
pair (pre-post) gives a positive extra voltage Sv^^^{t) = 



Av{t) 



LTP 
^th 



the LTD threshold 



(t), which produces LTP. This LTP reduces 
(t), so that the LTD caused by 
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the second pair (post-pre) is suppressed by the decreased 
threshold. Hence, the LTP caused by the first pair is domi- 
nant in synaptic modification for triplet spikes. A numerical 
simulation result is plotted in Fig. [4] for typical cases (Runge- 
Kutta method in MAPLE v. 13). An extreme case occurs when 
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Fig. 3. 

thresholds. The LTD area is suppressed by the increased threshold v^^^(t). 



The mechanism of the memristive STDP model with adaptive 

^th 



which changes proportionally to the extent of the preceding LTP and returns 
exponentially to the resting value —vtho- The suppression hence depends on 
the preceding LTP and the time interval between the LTD and the LTP. The 
function Av{t) is arbitrarily chosen for explanation. 



the decreased threshold v^^^{t) is beyond Av{t), which 
produces completely no LTD. Similar process can also be 
applied to the post-pre-post case, causing LTD dominantly. 
The net potentiation and depression regions are plotted in Fig. 
[5] by numerical simulations with chosen parameters, which 
is in accordance with Froemke's experimental records and 
the prediction by the suppression model. The dashed lines 
are boundary between LTP and LTD, corresponding to null 
synaptic modification or geometrically, cancelling of LTP area 
by LTD area. We can see that only when ti is sufficiently 
large, the net synaptic modification can then be predicted by 
the second pair, because the LTD threshold decreases to a too 
low level to suppress the following LTD. The boundary at 
large ti and t2 approaches the asymptotic line with a slope of 
— 1, because the LTP and LTD are independently additive, out 
of the time range of suppression. 

Let us estimate the suppression level on the second pair 
quantitatively (taking the pre-post-pre case for example). As 
mentioned, the change of the LTD threshold caused by the 
LTP, denoted as Av^^^, is approximately proportional to the 
change of the synaptic weight Aw, which is a function of the 
time interval of the first pair ti. If the piecewise exponential 
spike function spk{t) is adopted |5| 
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the STDP update function (,{ti) = Aw{ti) can be estimated 
in the piecewise exponential form 

f ^ -At/r+ 
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Thus the total change of LTD threshold integrated during the 
LTP is proportional to ti exponentially 
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Fig. 4. Suppression by the adaptive thresholds in the 2/1 triplet spikes for 
different time intervals. t2 is fixed at 10 ms, while ti is chosen at 25 ms (a), 
21.2 ms (b), 19 ms (c) and 10 ms (d), respectively. Black lines: Av(t); grey 
solid: v^^^ {t) and v^^^(t); grey dashed: :£vtho- Four typical suppression 
levels are shown: light, modest, heavy and complete suppression, which are 



produced by extra voltages ordered as Sv^ 
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. The net synaptic modification is depression for (a), null for (b) and 



potentiation for (c) and (d). The parameters are chosen as: rh 
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Thereafter, the LTD threshold increases exponentially to the 
resting value, described by 
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Fig. 5. Synaptic modifications for triplet spikes from experimental records 
and prediction of models, (a) Froemke's experimental data and prediction from 
the suppression model for '1/2' (left) and '2/1' (right) triplets. Red symbols: 
potentiation; blue symbols: depression. Circles: normal ACSF; triangles: 
high divalent ACSF with bicuculline. Dashed lines are the borders between 
potentiation and depression predicted by the suppression model, (b) The 
regions for potentiation and depression predicted by the memristive model 
with adaptive thresholds for '1/2' (left) and '2/1' (right) triplets. Dashed lines 
are the borders between LTD and LTP by the model. All the axes are plotted 
in logrithmic scale. The parameters are chosen as in Fig. |4] 



Suppose that the nonzero part of the extra voltage Sv^^^{t) = 
Av{t)—v^^^{t) is narrow, the amount of LTD is proportional 
to the extra voltage at t2 

with 

5(ti,t2) = 5pe-(*^/-^+*^/--"") (15) 

The term in the parenthesis on the rhs of Eq. ([14]) is just the 
amount of LTD corresponding to the pair-based model, and 
the second term S{ti^t2) gives the suppression on the LTD. 
We can see that the suppression amount is determined by both 
ti and ^2, which is a very wanted property. 

It is notable that this exponential dependence on the two 
time intervals also agrees with Froemke's suppression model. 
The model assumes a 'spike efficacy' of the /th spike (sup- 
posed to be a (5 function) as = 1 — e"*^^^"^*-!)/'^^ which is 
suppressed by the preceding spike in the same neuron at time 
ti-i. The synaptic modification is predicted by the pair rule 



{/\v{t)^VthQ)-S{tiM) (14) 



multiplied by the spike efficacies /S^wij = e^^^€j^^^F{Atij), 
where Atij = t^^^^ — is the time interval betwen the post- 



and pre- synaptic spikes and function F is defined as 
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_^-^At/r_ if At < 
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By these definitions, we can derive the suppression on the 
LTD by the preceding LTP to be -A-e-^^^/^^+^^/r^^ ^-^^^ 



= TsT- / {t- —Ts). This exponential dependence on and 
t2 is accordant with the previously derived suppression func- 
tion 5(^1, ^2) in the memristive model. Hence, the memristive 
model with variable thresholds can be regarded as another 
expression of the suppression principle for the triplet STDP 
rule. However, the notable difference from the suppression 
model is that the memristive model imposes suppression on 
the following LTD or LTP, instead of directly on the spikes. 

IV. Generalized Form and Biological Relations 

The memristive model in Eq. ^ and ([8]) can be regarded 
as a special form of the general model in the following form, 
which assumes to adapt both two thresholds to the presence 
of LTP or LTD 
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where the term with kpp (positive) indicates that the presence 
of LTP causes decrease in the LTP threshold, while the term 
with koD (positive) indicates that the presence of LTD causes 
increase in the LTD threshold. Hence, LTP will enhance the 
following LTP (also the current LTP itself) and suppress 
the following LTD; and vice versa. The terms with factors 
kpD and k^p impose suppression as previous. We are not 
intended to identify the specific biological quantities for the 
variable thresholds in this mechanistic model, but certain 
relations may be addressed. The variable thresholds can be 
viewed as an expression of short term plasticity. Since STDP 
depends on NMDA receptor activation or glutamate bound for 
presynaptic events, and on the rise in the voltage-dependent 
influx Ca^+ concentration level and NMDA channels for 
postsynaptic events, the variable thresholds are correlated with 
the probability of release of neurotransimitters Prei and the 
probability of the postsynaptic channel openning P5, both of 
which reveal short term plasticity by exhibiting a rapid rise 
to a high level and returning back exponentially to the resting 
value ifTTl . In addition to chemical nature, synapses with gap 
junctions may be regarded as a more direct correspondance 
to the memristive model |TT1|[2T|, which produce a synaptic 
current proportional to the difference between the pre- and 
post-synaptic membrane potentials. In this case, the variable 
thresholds can be determined directly by inner electric prop- 
erties of the synapse. 

In addition, we want to point out that this memristive STDP 
model can also be viewed as a rate-based model, regarding 
Vpre{t) and Vpost{t) as the rate function of pre- and post- 
synaptic events, instead of the membrane potentials. Therefore, 
in general, the equation of synaptic modification rate can be 
written as a general function on the excessive rate difference 
over the thresholds 

[Fit)+Fth]-) (19) 



dt 



with 



(17) 



(18) 



¥{t) = (Vpostit) - Vposto)n - {\pre{t) - \preo) (20) 
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where the vector defines the rate functions, referred to the rest- 
ing rates Vposto (n is the unit vector) and \preO^ corresponding 
to multi-presynaptic neurons (connected to one postsynaptic 
neuron), among which competition can be introduced. 

V. Conclusions 

As we have demonstrated, the new mechanism of adaptive 
thresholds is an expression of the principle of suppression, 
which can make the memristive STDP model compatible with 
the both pair and triplet rules. The exponential dependence 
on the time intervals is comparable with that predicted in 
the suppression model. The net synaptic potentiation and 
depression regions are also accordant with the experimental 
results and the prediction by the suppression model. Pos- 
sible biological quantities related to the adaptive thresholds 
are addressed, which suggests an expression of short term 
plasticity. However, the most important is that we can foresee 
that this model may be used by neuromorphic engineers in 
the realization of emulators of biological cortical networks, 
for which implementations of suitable memristor devices or 
equivalent circuit designs are demanded. 

References 

[I] G. S. Snider, "Spike-Timing-Dependent Learning in Memristive Nanode- 
vices," IEEE/ ACM International Symposium on Nanoscale Architectures, 
85-92 (2008). 

[2] A. Afifi, A. Ayatollahi and F. Raissi, "STDP Implementation using 
Memristive Nanodevice in CMOS-Nano Neuromorphic Networks," lEICE 
Electronics Express, 6 (3), 148-153 (2009). 

[3] B. Linares -Barranco and T. Serrano-Gotarredona, "Memristance can 
Explain Spike-Time-Dependent-Plasticity in Neural Synapses," Nature 
Precedings: hdl:10101/npre.2009.3010.1. 

[4] B. Linares-Barranco, T. Serrano-Gotarredona, "Exploiting Memristance 
in Adaptive Asynchronous Spiking Neuromorphic Nanotechnology Sys- 
tems," lEEE-NANO 2009, 601-604 (2009). 

[5] C. Zamarreno-Ramos, L.A. Camunas-Mesa, J.A. Perez-Carrasco, T. 
Masquelier, T. Serrano-Gotarredona T, and B. Linares-Barranco, "On 
Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a 
Self-Learning Visual Cortex," Frontiers in Neuroscience, 5, Article 26 
(2011). 

[6] J. A. Perez-Carrasco, C. Zamarreno-Ramos, T. Serrano-Gotarredona, 
and B. Linares-Barranco, "On Neuromorphic Spiking Architectures for 
Asynchronous STDP Memristive Systems," Proceedings of 2010 IEEE 
ISCAS, 1659-1662 (2010). 

[7] S. H. Jo, K.-H. Kim, T. Chang, S. Gaba, W. Lu, "Si Memristive Devices 
Applied to Memory and Neuromorphic Circuits," Proceedings of 2010 
IEEE ISCAS, 13-16 (2010). 

[8] W. Gerstner, R.Kempter, J. Leo van Hemmen, and H.Wagner, "A Neu- 
ronal Learning Rule for Sub-millisecond Temporal Coding," Nature, 383, 
7678 (1996). 

[9] W. Gerstner, "Spiking Neurons," in Pulsed Neural Networks, eds W. 

Maass and C. M. Bishop, Cambridge, MA: MIT Press, 353, 1999. 
[10] R. Kempter, W. Gerstner, and J. L. van Hemmen, "Hebbian Learning 

and Spiking Neurons," Phys. Rev. E, 59 4498-4514 (1999). 

[II] P. Day an, L. F. Abbott, Theoretical Neuroscience, Cambridge, MA: MIT 
Press, 2001. 

[12] L. O. Chua, "Memristor - the Missing Circuit Element," IEEE Trans. 
Circuit Theory 18, 507-519 (1971). 

[13] L. O. Chua, S.M. Kang, "Memristive Devices and Systems," Proc. IEEE, 
64, 209-223 (1976). 

[14] D. B. Strukov, G. S. Snider, D. R. Stewart, and S. R. Wilhams, "The 
Missing Memristor Found," Nature (London) 453, 80-83 (2008). 

[15] R. C. Froemke, and Y. Dan, "Spike-Timing-Dependent Synaptic Modi- 
fication Induced by Natural Spike Trains," 

[16] J. P. Pfister, and W. Gerstner, "Triplets of Spikes in a Model of Spike 
Timing-Dependent Plasticity," J. Neurosci., 26, 9673-9682 (2006). 

[17] M. Hart, N. Taylor, and J. Taylor, "Understanding Spike-Time- 
Dependent Plasticity: a Biologically Motivated Computational Model," 
J. Neurocomp., 69, 2005-2016 (2006). 



[18] H. X. Wang, R. C. Gerkin, D. W. Nauen, G. Q. Bi, "Coactivation and 
Timing-Dependent Integration of Synaptic Potentiation and Depression," 
Nature Neurosci., 8, 187-193 (2005) 

[19] D. O. Hebb, The Organization of Behavior: A Neuropsychological 
Theory, Wiley, New York (1949). 

[20] G. Q. Bi, and M. M. Poo, "Synaptic Modifications in Cultured Hip- 
pocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and 
Postsynaptic Cell Type," J Neurosci, 18 10464-72 (1998). 

[21] E. R. Kandel, J. H. Schwartz, and T. M. Jessell, Principles of Neural 
Science (4th ed.). New York: McGraw-Hill, 2000. 



